Coding of 3d Meshes and Video Textures for 3d Video Objects

We present a complete system for efficient 3D video object extraction, representation, coding, and interactive rendering. 3D video objects provide the same functionalities as virtual computer graphic objects but also depict motion and appearance of real world moving objects. They can be viewed interactively from any direction and can be integrated in complete 3D scenes together with other virtual or real world elements. In this work, data representation is based on 3D mesh models and view-dependent texture mapping using video textures. The geometry extraction is based on a shape-from-silhouette algorithm. The resulting voxel models are converted into 3D meshes. For efficient compression of such dynamic 3D meshes, we present a novel algorithm that significantly outperforms available standard approaches. The corresponding video textures are preprocessed taking the object’s shape into account and coded using H.264/AVC. The presented results show that a complete and efficient transmission system for 3D video objects can be built.